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Method for recognizing the path of a tip of a body on a medium 
Baclcground of the invention 

5 

The invention relates to a method for recognizing the path of a tip of a body 
on a medium, comprising determination of an angle of orientation of the body 
by processing measurement data supplied to a processing unit by at least 
one angle sensor arranged In the body, the body comprising a force sensor 

10 measuring the reaction force of the tip of the body in contact with the 
medium, the force sensor supplying data representative of the reaction force 
in almost continuous manner to the processing unit, the processing unit 
determining the orientation of the reaction force with respect to the plane of 
the medium from the measurement data from the angle sensor and from the 

15 force sensor. 

State of the art 

20 At present, digital pens on the market require a prepared medium or a 
reference source enabling the movements of the tip of the pen to be 
recognized, for example digitizing tables, special screens, ultrasonic sources, 
electromagnetic sources or special papers, which complicates use of the 
pen. 

25 

A trace written on a medium is transcribed onto a computer screen by means 
of the pen. Typically, a digital pen enables written symbols, for example 
characters and signatures, to be recognized, 

30 Generally, a digital pen comprises several sensors, for example inertia 
sensors of the accelerometer type, and angle sensors for example of the 



magnetometer or gyrometer type, and possibly a detector of the reaction 
force of a pen tip in contact with the medium, enabling it to be recognized 
whether the pen is in contact with a writing medium or not. The acceleration 
of the pen tip on the writing medium is obtained by processing measurement 
data supplied by the sensors. A double mathematical integration of a quantity 
that is a function of the acceleration then enables an approximate 
determination of the path of the pen tip on the writing medium to be made. 
The data processing operations are performed by a processing unit located 
for example in the pen. 

The document US5548092 describes a method for visualizing written 
information on a medium by measuring the forces applied to the tip of a pen. 
The pen comprises a sensor to measure the force of the pen tip on the 
medium. Additional sensors enable the movements and orientation of the 
pen in relation to the medium to be measured, even if the pen is not in 
contact with the medium. A force having the direction of the longitudinal axis 
of the pen comprises components oriented along two orthogonal axes 
arranged in a writing plane. The forces measured in the reference frame of 
the pen are transformed into an absolute reference frame. The document 
defines an angle of inclination of the pen with respect to the gravitational axis 
and an azimuth angle with respect to one of said orthogonal axes. A friction 
force is represented by the sum of a static component and of a dynamic 
component dependent on the speed. The static component is subtracted 
from the measured force to define a net force which is by definition zero 
when the measured force is lower than the product of the longitudinal force 
and of the static friction coefficient. Then the time derivative of the quantity of 
movement is expressed as a function of the net force and of the dynamic 
friction force. The differential equation is then solved to determine the speed 
and the position. Calculation of the position and speed components of the 
pen tip in the plane of the medium is performed, by integration, taking 
corresponding components of the net force into account. 
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Due to the intrinsic structure of the pen described in the document 
US5548092, the azimuth angle is assumed to be constant and the pen 
comprises an edge preventing the user from turning the pen when writing. 
5 This means that the pen is in a fixed position in the user's hand. This 
hypothesis is very restrictive with respect to reality. 

The document W099/67652 describes a pen comprising force, acceleration 
and contact sensors integrated in a measuring device comprising an inertia! 

10 mass coupled to the pen tip. In addition, the pen comprises a device for 
measuring the angles of inclination of the pen. The measuring devices 
transmit measurement data to a control unit. The measurement data are 
processed to determine the forces and accelerations applied to the pen. A 
method of using the pen comprises an initialization phase, a measuring 

15 phase and a data processing phase. The data enable it to be determined 
whether the pen is in contact with a writing medium or not. If a contact is 
detected, the data are interpreted as forces. If there is no contact, the data 
are interpreted as accelerations. 

20 

Object of the invention 

The object of the invention is to simplify recognition of the path of a tip of a 
body on a medium and to increase the path recognition precision, in 
25 particular for recognition of the path of a pen tip on a writing medium, while 
simplifying use of the pen. 

According to the invention, this object is achieved by the appended claims, 
and in particular by the fact that the processing unit determines a vector 
30 tangential to the path by projection of the reaction force in the plane of the 
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medium, the path being determined by at least one mathematical integration 
of a quantity that is a function of the vector tangential to the path. 

5 Brief description of the drawings 

Other advantages and features will become more clearly apparent from the 
following description of particular embodiments of the invention given as non- 
restrictive examples only and represented in the accompanying claims, in 
10 which: 

Figure 1 represents a digital pen according to the prior art. 

Figures 2 et 3 illustrate two particular embodiments of a recognition method 

according to the invention, in the form of functional block diagrams. 

15 

Description of particular embodiments 

In figure 1 , a pen 1 comprises an accelerometer 2, an angle sensor 3 and a 
20 force sensor 4 arranged in the case 5 of the pen, in a front part of the pen 1 . 
The force sensor 4 is mechanically connected to the tip 6 of the pen and the 
accelerometer 2 is advantageously located near the tip 6. The angle sensor 3 
can be formed by a set of three gyrometers or preferably by a set of three 
magnetometers. Electronic circuits, in particular an analog-to-digital converter 
25 7, a processing unit 8 and a transmitter 9 or transceiver, are also arranged in 
a rear part of the pen 1 . Data processing can be performed by the processing 
unit 8 or by a remote station receiving the data by means of the transmitter 9. 
The pen 1 enables writing to be performed on any medium 10 without 
requiring additional equipment. In figure 1, the angle 0 of the longitudinal axis 
30 L of the pen 1 , i.e. the angle of inclination of the pen 1 , is defined with respect 
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to the plane of the medium 1 0. The medium is preferably flat. A surface with 
small deformations can however also be used. 

In a simplified first embodiment illustrated in figure 2, the path of the tip 6 of 
5 the pen 1 is determined from data SI and S2 supplied to the processing unit 
8 respectively by the angle sensor 3 and the force sensor 4. The recognition 
method can comprise a calibration step F1 of the orientation 60 of the 
medium 10, before beginning writing. For example, the pen is placed at a 
predetermined angle with respect to an axis perpendicular to the medium, 

10 preferably perpendicularly to the medium 10, during the calibration step F1 
and the angle sensor 3 thus supplies the angle of orientation 00 of the 
medium 10. If the orientation of the medium 10 is subsequently modified, the 
calibration has to be updated. If the medium 10 comprises several zones 
having different orientations, the calibration can be updated each time the tip 

15 6 of the pen 1 changes zone. 

Estimation of the angle 6 of the pen 1 with respect to the angle of orientation 
90 of the medium 1 0 is then performed in known manner, in a step F2, from 
the measurement data SI of the angle sensor 3. 

20 

The data S2 are supplied to the processing unit 8 by the force sensor 4 in 
almost continuous manner. They are representative of the reaction force of 
the tip 6 of the pen 1 in contact with the medium 1 0. The measurement is 
three-dimensional and proportional to the reaction force. Information on the 

25 direction and amplitude of the reaction force and not a simple contact 
detection is thus obtained. The reaction force is measured in the reference 
frame of the pen 1 . The orientation of the reaction force with respect to the 
plane of the medium 10 is determined (F3) from the measurement data SI of 
the angle sensor 3, more particularly from the angle 9, and from the 

30 measurement data S2 of the force sensor 4. The reaction force in the 
reference frame of the medium 10 is thus obtained. Then the reaction force is 
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projected (F4) into the plane of the medium 10, which enables the 
component perpendicular to the medium 10 corresponding to the pressing 
pressure applied by user to be eliminated, which is not without importance for 
determining the path of the tip 6 of the pen 1 . The component in the plane of 
5 the medium 10, the result of the projection, is due to the friction force of the 
tip 6 of the pen 1 on the medium 1 0. This friction force is anti-parallel to the 
movement of the tip 6 of the pen 1 in the plane of the medium 1 0, tangential 
to the path of the tip 6 of the pen 1 on the medium 10. A vector 6 is thus 
obtained tangential to the path of the tip 6 of the pen 1, which vector is 
10 representative of the direction of the speed of the tip 6 in the plane of the 
medium. 

In a step F5 comprising a simple mathematical integration of the tangential 
vector 6, the processing unit 8 determines the path of the tip 6 of the pen on 
15 the medium 10. 

It should be noted that according to the document US5548092, the net force, 
which is used for calculating the position and speed of the tip of the pen, is 
equal to the sum of a quantity proportional to the speed (tangential to the 
20 path) and of a quantity proportional to the acceleration (not necessarily 
tangential). The net force used in the document US5548092 does not 
therefore correspond to a vector tangential to the path, in so far as it 
comprises an acceleration vector, which is not necessarily tangential to the 
path. 

25 

In a second embodiment, illustrated in figure 3, the path of the tip 6 of the 
pen 1 is determined from data S1, S2 and S3 supplied to the processing unit 
8 respectively by the angle sensor 3 and force sensor 4 and the 
accelerometer 2. Processing of the data S3 from the accelerometer enables 
30 ^ a better precision of determination of the path to be obtained. 
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The accelerometer 2 being influenced by gravitation, it is desirable to 
eliminate the contribution of gravity to the measurement. The measurement 
data supplied by the angle sensor 3 enable the contribution G of gravity to 
the measurement of the accelerometer 2 to be estimated (F6) in known 
5 manner, and said contribution G to then be eliminated (F7) from the data S3 
supplied by the accelerometer 2 so as to obtain reduced data S4 which are a 
function of the acceleration of the movement only. 

The reduced data S4 thus represent the acceleration of the movement at the 
10 location of the accelerometer 2, which is in principle different from the 
acceleration A of the tip 6 of the pen 1. To determine the acceleration A of 
the tip 6 of the pen 1 in a step F8, estimation of the angle 9 of the pen 1 with 
respect to the angle of orientation 90 of the medium 10 is performed in known 
manner in a step F'2 from the measurement data SI of the angle sensor 3, 
15 and also from the angular speed VA and angular acceleration AA of the pen 
1 , respectively by means of the first and second derivative of the angle 9 with 
respect to time. To perform the step F8, the laws of composition of 
movements of conventional mechanics are used, taking the vector linking the 
location of the accelerometer 2 and the tip 6 of the pen 1 into account. 

20 

The acceleration A of the tip 6 of the pen 1 can then be projected (step F9) 
into the plane of the medium 10 so as to obtain the acceleration a of the tip 6 
of the pen 1 on the medium 10. The projection in the plane of the medium 10 
can therefore be calculated from the data SI and S3, respectively supplied 
25 by the angle sensor 3 and the accelerometer 2 and enabling the angle of 
orientation 90 of the medium 10, the angle 9 of the pen 1 with respect to the 
angle of orientation 90, and the acceleration A of the tip 6 of the pen 1 to be 
determined. 

30 In the step F'4, as in the step F4. the vector 6 tangential to the path of the tip 
6 of the pen 1 is obtained, and in addition, by normalization of the tangential 
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vector 6, a unitary vector u tangential to the path of the tip 6 of the pen 1 is 
obtained. 

In a step F10, the processing unit 8 determines the scalar product of the 
unitary vector Q and of the acceleration a of the tip 6 of the pen 1 on the 
medium 10, which enables the component aT of the acceleration tangential 
to the path to be determined. The path is then determined by double 
mathematical integration F11 of the tangential component aT of the 
acceleration. 

The component aT of the acceleration tangential to the path may be 
determined by the scalar product of the unitary vector Q and of the 
acceleration A of the tip 6 of the pen 1 , without making the projection F9 of 
the acceleration A of the tip 6 of the pen 1 in the plane of the medium 10.. 
However, the projection step F9 enables information to be drawn on the 
curvature of the path by means of the component of the acceleration 
perpendicular to the path. 

Combined use of the angle sensor 3 and force sensor 4 enables the 
contributions of forces that are not connected to the path, for example the 
weight or pressure of the pen 1 perpendicularly to the medium, to be 
correctly eliminated from the measurement of the acceleration aT. 

Using the method according to the invention in particular enables signature 
recording and recognition to be efficiently performed. For example, several 
signatures are recorded for each person using the pen 1 to determine a 
mean signal for each person. When the pen 1 is operating in a signature 
recognition mode, processing, typically consisting in minimizing the quadratic 
distance between a standardized signature measurement and the previously 
recorded standardized mean signals, enables the signature to be recognized 
with certainty. 
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The invention is not limited to recognition methods of a pen tip path. The pen 
1 can be replaced by any body comprising for example any actuator, for 
example an etching tip, the path whereof is determined during actuation. 

5 

The method also enables the path of a measuring device, for example a 
feeler, comprising any sensor, for example a thermal, electric or photometric 
sensor, to be determined- A physical measurement by means of a sensor 
associated with the body 1 is thus made at the same time as path recognition 
10 is performed, which enables a mapping of the measured physical quantity to 
be established by correlating the measurement with the determined path. 



